Methods and devices for detecting and responding to changes in eye conditions during presentation of video on electronic devices

ABSTRACT

Methods and devices are disclosed herein for detecting and responding to changes in eye conditions during presentation of video on electronic devices. One embodiment involves monitoring, via an electronic tracking device, an eye of a person watching a video on an electronic device to monitor a viewing direction of the eye. The embodiment determines that the person is watching the video based on the viewing direction of the eye and detects a change in the viewing direction of the eye. In response to detecting the change in viewing direction of the eye, the embodiment determines that the person is focused on something other than the video based on additional monitoring of the eye. Presentation of the video is changed based on determining that the person is focused on something other than the video. For example, the video may be paused, discontinued, minimized, or a targeted advertisement inserted.

TECHNICAL FIELD

This disclosure relates generally to electronic devices that presentvideo content and devices used in, on, or with those electronic devicesto detect and respond to changes in eye conditions of the personwatching the video content.

BACKGROUND

Wearable devices are increasing in use and popularity. Such technologyincludes clothing and accessories incorporating computer and advancedelectronic technologies. Some wearable devices display electroniccontent to persons wearing the devices. For example, electronic contentcan be displayed on watches, eye glass lenses, or projected from theworn electronic devices onto a nearby surface. Existing user interfacecomponents and techniques for wearable electronic devices arecumbersome, time-consuming, and otherwise inadequate.

SUMMARY

Methods and devices are disclosed herein for detecting and responding tochanges in eye conditions during presentation of video on electronicdevices. One embodiment involves monitoring, via an electronic trackingdevice, an eye of a person watching a video on an electronic device tomonitor a viewing direction of the eye. The embodiment determines thatthe person is watching the video based on the viewing direction of theeye and detects a change in the viewing direction of the eye. Inresponse to detecting the change in viewing direction of the eye, theembodiment determines that the person is focused on something other thanthe video based on additional monitoring of the eye. Presentation of thevideo and/or audio associated with the video is changed based ondetermining that the person is focused on something other than thevideo. For example, the video may be paused, discontinued, minimized, ora targeted advertisement inserted and/or audio associated with the videomay be muted or reduced.

Methods and devices are also disclosed herein for identifying a person'sinterest based on changes in eye conditions during presentation of videoon wearable electronic devices. One embodiment involves monitoring, viaan electronic tracking device, an eye of a person watching a video on awearable electronic device to monitor dilation of a pupil of the eye.The embodiment involves determining a level of interest based on achange in the dilation of the pupil of the eye and associating the levelof interest with content displayed in the video when the changeoccurred. Customized content is presented on the wearable electronicdevice based on the level of interest associated with the contentdisplayed in the video when the change occurred. For example, if aperson's interest in automobiles is identified, an automobileadvertisement may be selected and presented at the next scheduledadvertisement break.

These illustrative embodiments and features are mentioned not to limitor define the disclosure, but to provide examples to aid understandingthereof. Additional embodiments are discussed in the DetailedDescription, and further description is provided there.

BRIEF DESCRIPTION OF THE FIGURES

These and other features, embodiments, and advantages of the presentdisclosure are better understood when the following Detailed Descriptionis read with reference to the accompanying drawings.

FIG. 1 is a block diagram depicting an example of a system employingdevices for detecting and responding to changes in eye conditions duringpresentation of video.

FIG. 2 is a block diagram illustrating exemplary modules for a userdevice of FIG. 1.

FIG. 3 depicts eyeglasses comprising components used for detecting andresponding to changes in eye conditions during presentation of video onwearable electronic devices.

FIG. 4 depicts an example of an eye movement.

FIG. 5A depicts an example eye lens size and shape.

FIG. 5B depicts an example of a change in the eye lens size and shape ofFIG. 5A.

FIG. 6A depicts an example pupil dilation of an eye.

FIG. 6B depicts an example of a change in the pupil dilation of the eyeof FIG. 6A.

FIG. 7 is a flow chart of an exemplary method for detecting andresponding to changes in eye conditions during presentation of video onelectronic devices.

FIG. 8 is a flow chart of an exemplary method for identifying a person'sinterest or disinterest based on changes in eye conditions duringpresentation of video on electronic devices.

FIG. 9 is a block diagram depicting example hardware implementations forthe components described in FIG. 1.

DETAILED DESCRIPTION

Existing user interface techniques for controlling wearable electronicdevices are cumbersome, time-consuming, and otherwise inadequate,especially with respect to controlling video content. This inventionaddresses these issues by detecting and responding to changes in eyeconditions during presentation of video on electronic devices. Anelectronic tracking device, such as a sensor or camera, monitors the eyeto detect changes that can signal the intentions of the person watchingthe video. For example, the physical condition of the person's eyecondition (or how the condition changes over time) may indicate that theperson is focused on something other than the video, that the person'sfocus has returned to watching the video, that the person has fallenasleep, that the person is interested or disinterested in particularcontent in the video, and otherwise provide information about the personthat can be used as triggers. For example, a person looking away andfocusing on a distant object can trigger a pause in the presentation ofthe video. Similarly, when the person looks back at and focuses on thevideo, presentation of the video can be resumed.

A video can thus be controlled, not only without the user having to usehands or voice, but without the user having to intentionally initiatethat control. In one example, the user does not have to intend the videoto pause, the video pauses simply by the person looking away andfocusing on something else.

The eye movement triggers and associated responses can be preconfiguredor learned. For example, the devices may monitor the particular person'sreactions over time, identifying that the person generally does notchange the video when looking away and changing focus for less thanthree seconds before turning back and also identifying that the personpauses the video when looking away and changing focus for more thanthree seconds. Based on this learning, the person's device may beconfigured to pause after detections of the person looking away andchanging focus for more than three seconds. A different person's device(based on observations of that person's reactions) may be configured toturn off the display of content altogether after that person looks awayand changes focus for more than ten seconds. Thus, one or both of thetriggers and responses can be learned based on observations of theperson wearing the device. If multiple people wear the device theidentity of each individual can be determined, e.g., based on userinput, eye recognition, etc. The triggers and responses of eachindividual using the device can be customized to the individual. Inanother embodiment, multiple devices used by a given person maycommunicate person-specific learned or inputted settings. For example,if a husband picks up and uses his wife's device, the wife's device canbe configured to behave exactly the same as if the husband had picked uphis own device, accessing and/or utilizing all of the historical andlearned behaviors from the husband's device.

A tracking device additionally or alternatively monitors the person'seye to assess the person's interest in the content being watched. In oneexample, the person focusing on the video and focusing on somethingother than the video is tracked during the video presentation toidentify portions of the video in which the person was more or lessinterested. A person looking away from the video during the actionscenes more than the person looking away from the video during dialoguescenes can be used to determined that the person is more interested indialogue than action, that the person dislikes action or violence, etc.

In another example, the relative size of the pupil of the eye of theperson is tracked. An increase in size in the pupil is used as anindicator that the person is interested in the content being presentedduring the pupil increase. Conversely, a decrease in size in the pupilis used as an indicator that the person is disinterested or dislikes thecontent being presented. The identified level of interest of the personin one or more products, services, topics, or other subject matter(i.e., how much the person favors or disfavors those things) is used tosupplement the person's profile and/or present advertising or othermaterials (e.g., additional video using the wearable device, separatee-mail, mail, etc.) to the person.

In another example, the tear layer on the eye is monitored to detect itsmoisture content. A reduction in moisture content, e.g., the eye dryingout, may indicate a reduction in blinking, which may suggest that theperson is unwilling to blink during an intense scene. An increase in thetear layer may indicate crying or other state of interest or emotiontriggered by the displayed content.

These illustrative examples are given to introduce the reader to thegeneral subject matter discussed here and are not intended to limit thescope of the disclosed concepts. The following sections describe variousadditional aspects and examples with reference to the drawings in whichlike numerals indicate like elements, and directional descriptions areused to describe the illustrative examples but, like the illustrativeexamples, should not be used to limit the present disclosure.

As used herein, the phrase “electronic device” refers to anyelectrically-powered device. Examples of electronic devices includewearable electronic devices, handheld electronic devices, such as smartphones and tablets, and larger electronic devices, such as laptop anddesktop computers and televisions.

As used herein, the phrase “wearable electronic device” refers to anyelectrically powered device that can be temporarily or permanentlysecured to a person. Examples of wearable electronic devices include,but are not limited to, eyeglasses containing electronics, hats andclothing containing electronics, watches, wristbands, armbands, etc.

As used herein, the phrase “video” refers to any electronic content thatincludes multiple images presented over time. Video can, but need not,include audio. Examples of videos include, but are not limited to,movies, shows recorded for television, shows or content recorded by acamera over time, animated cartoons, electronic content with moving ornon-static items (such as content created for playback on Adobe® Flash®Player, etc.), and electronic slideshows.

As used herein, the phrase “focus” refers to the condition of a person'seye viewing an object at a particular distance clearly, otherwise knownas the focal plane. As examples, a person's eye may be focused toclearly see a video displayed up close, e.g., on a lens of eyeglasses onthe person's head, may be focused to clearly see a face of a personstanding a few feet away, or may be focused to clearly see a distantmountain peak. When a person's focus changes, the size and/or shape of alens within the person's eye generally changes to allow the person toclearly see one or more objects of interest based on the distance of theobject(s) from the person.

As used herein, the phrase “eyeglasses” refers to frames bearing one ormore lenses worn in front of the eyes. The lenses may, but need not,improve the person's vision. The lenses may, but need not, provide sunor brightness protection.

Referring now to the drawings, FIG. 1 is a block diagram depicting anexample of a system employing devices for detecting and responding tochanges in eye conditions during presentation of video. In this example,video server 102 provides video for presentation on user devices 110 a-cto persons 112 a-c, respectively, through server 115. Video content canbe streamed or downloaded to the user devices 110 a-c. In an alternativeembodiment, videos are provided to the user devices 110 a-c locallyrather than from a remote server.

The user devices 110 a-c detect and respond to changes in eye conditionsof persons 112 a-c during presentation of the videos on user devices 110a-c. Information about changes in the eye conditions of persons 110 a-cis used to control the presentation of videos on user devices 112 a-cand/or is provided to tracking server 104. Tracking server 104 maintainsprofiles for persons 112 a-c. In one embodiment, the user devices 110a-c include computer instructions to determine responses to the changesin eye conditions. In an alternative embodiment, tracking server 104includes computer instructions to remotely determine responses to thechanges in eye conditions. For example, tracking server 104 may identifyan interest in a particular product based on person 112 a's eyecondition changing and, in response, instruct advertising server 106 toprovide an advertisement about the product to user device 110 a forpresentation to person 112 a.

In another example, the management server 102 provides acustodian-specific user interface that provides custodian specifictools. Exemplary tools identify electronic contracts that are coming duefor review, identify electronic contracts coming due for expungementaccording to an expungement policy, identify new contracts, identifycustodian events for individual contracts that have been performed, andidentify electronic contracts designations or classifications, e.g.,contracts designated for special scrutiny.

FIG. 2 is a block diagram illustrating exemplary modules forimplementing functions in user device 110 a of FIG. 1. User device 110 aincludes modules 202, 204, 206, 208, 210. Each module may include one ormore devices or components configured to provide one or more functions.In additional or alternative embodiments, these modules may be providedin separate, communicatively-coupled devices. For example, the displaydevice 202 may be separated from the eye tracking device, and both maybe separated from the analysis engine 210.

Module 202 is a display device, such as an LED, LCD, plasma, projector,or light display configured to display video.

Module 204 is an audio device such as a speaker configured to producesound associated with the displayed portion of the video.

Eye tracking device 206 is configured to track (or capture/recordinformation used to identify) one or more conditions of an eye,including but not limited to, a direction in which the eye is looking,how open the eye lid is, how tired the eye is, how dilated the pupil ofthe eye is, attributes of the size and/shape of a lens within the eye,or any other measurable attribute of the eye. The eye tracking devicemay comprise a camera, a sensor, a device for bouncing light or soundwaves off of eye structures, or any other tracking component capable ofmeasuring an attribute of the eye. Eye tracking device may include aneye recognition component for recognizing a person using user device 110a based on distinguishing characteristics of the eye, such as eye color,eye size, eye pattern, eyelid physical characteristics, etc.

Module 208 on user device 110 a caches or stores electronic content forpresentation on the user device 110 a. Examples of electronic contentstored in module 208 include, but are not limited to, videos,advertisements, games, and software applications.

Module 210 provides an analysis engine configured to analyze informationabout the condition of the eye of the person 112 a (or other users ofthe device 110 a) to determine and/or provide an appropriate response.For example, module 210 may recognize, based on captured images of theeye, that the pupil of the eye has dilated during a portion of apolitical candidate's speech relating to the economy and, based on thatrecognition, present a political advertisement relating to economicissues during an upcoming commercial break.

FIG. 3 depicts eyeglasses comprising components used for detecting andresponding to changes in eye conditions during presentation of video onwearable electronic devices. In this example, display module 202 isembedded in a lens portion and audio module 204 is embedded in anear-portion of the frame. Eye tracking device 206 is positioned on theframe in a location that allows it to capture or sense the condition ofthe eye that is watching the display device 202. In an alternativeembodiment, multiple eye tracking devices are positioned on the framealong the perimeter of the frame 302 around lens 304 so that conditionsof the eye can be captured, sensed, and/or measured from differentvantage points.

In FIG. 3, the eyeglasses also include a storage medium 208 storing theelectronic content and an analysis engine 210 (a processor executingstored instructions) embedded within the frame 302 of the eyeglasses.The modules 202, 204, 206, 208, 210 depicted in the example of FIG. 1can be positioned, embedded, secured, or otherwise used in various otherconfigurations and may be communicatively-coupled to one another and/orcoupled to a power source (not shown), by any appropriate connectiontype. Communication may be through wires or through wireless signals.

In one embodiment, one or more of modules 202, 204, 206, 208, 210 areentirely or partially implemented on a smartphone, tablet, or otherelectronic device carried, worn, or used by person 110 a. For example, asmart phone may store a video that is streamed and displayed on theeyeglasses of FIG. 3. The smart phone may also include an analysisengine 210 that receives eye condition information e.g., images or data)from the eyeglasses and determines an appropriate response, for example,by communicating with tracking server 104 for an advertisement selectionand with advertising server 106 to receive a selected advertisement. Theselected advertisement may be provided on the smart phone and/or on theeyeglasses.

FIG. 4 depicts an example of an eye movement. In this example, the eyerotates from position 402 to position 406. Such a movement can bedetected based on a camera or sensor capturing image information used toidentify the location of the eye, for example, identifying a location ofthe pupil 404 before the movement and of the pupil 408 after themovement. The distance of movement of the eye may be determined in oneembodiment based on the distance that the center of the pupil moves.Using the center of the pupil as the basis for determining movement canprovide a more accurate estimate of eye movement distance in certaincircumstances than other techniques, for example, where the eye dilatesas it moves. Movement of the eye can be used as an indicator that theperson is looking in a different direction. In one example, a thresholddistance is used to determine whether the person is looking in adifferent direction away from a displayed video. If the eye moves adistance that is greater than the threshold, then the system canidentify that the person is looking at something other than the video.The distance can be determined based on the size of the displayedcontent and its proximity to the person's eye. The threshold is setand/or adjusted by the person in one embodiment.

FIGS. 5a-b depict an example of change in eye lens size and shape. Inthis example, the lens 502 changes shape between the figures. Such achange in shape can be detected using a camera or sensor. In oneexample, the eye tracking device bounces a signal off of the interior ofthe eye, measures the response, and identifies an attribute of the sizeor shape of the lens 502 based on the response that is received.

FIG. 6 depicts an example of a change in pupil dilation of an eye. Inthis example, the size of the pupil 608 within iris 606 enlarges as theeye dilates. Such a change in pupil size can be detected using a cameraor sensor.

FIG. 7 is a flow chart of an exemplary method for detecting andresponding to changes in eye conditions during presentation of video onelectronic devices. Method 700 can be performed by one or more of thedevices of FIG. 1 or any other suitable devices.

The method 700 involves monitoring an eye of a person watching a videoon a wearable electronic device to monitor a viewing direction of theeye, as shown in block 702.

The method 700 further involves determining that the person is watchingthe video based on the viewing direction of the eye, as shown in block704. This can be determined based on an expected position of a center ofthe pupil and/or iris given a location of the displayed video relativeto the person's head. For example, if the video is displayed on a leftportion of an eyeglasses lens worn by the person, the center of theperson's pupil/iris can be expected to be oriented in that direction.

The method 700 further involves detecting a change in the viewingdirection of the eye, as shown in block 706. This can be detected, forexample, based on a camera or sensor capturing image information andidentifying a location of the pupil before the movement and of the pupilafter the movement.

The method 700 also involves determining that the person is focused onsomething other than the video based on additional monitoring of theeye, as shown in block 708. This may be done in response to detectingthe change in viewing direction of the eye. Determining that the personis focused on something other than the video may be based on determiningthat the person's focal plane has changed, for example, based ondetecting a change in the size and/or shape of a lens within theperson's eye. In another example, the additional monitoring of the eyeinvolves detecting that the viewing direction is constant in a directionaway from the video for at least a threshold amount of time.

Determining that the person is focused on something other than the videomay additionally or alternatively be based on a detection of a change ofmovement of a head of the person, a sound of a voice of a particularperson, an ambient noise, or the eye closing for a length of time longerthan a blink threshold.

In one embodiment, determining that the person is focused on somethingother than the video is additionally or alternatively based on alearned, person-specific threshold for the person. In one example, thelearned, person-specific threshold is determined based on prior eyecondition change of the person and prior intentional action by theperson determined to be associated with the prior eye condition changebased on prior observations. For example, a 5 second threshold may havebeen identified based on observing that the person previously tended tostop the content in circumstances in which the person focused onsomething other than the content for more than 5 seconds, but did notstop or rewind the content in circumstances in which he or she focusedon something other than the content for less than 5 seconds.

In block 710, the method involves changing presentation of the video, asshown in block 710. This can be based on determining that the person isfocused on something other than the video. Changing the presentation caninvolve one or more of displaying the video in a smaller size displayarea, pausing the video, removing the video from being displayed, orreducing volume of audio associated with the video, among other things.

After changing presentation of the video, e.g., by pausing the video, asubsequent eye condition change may undo to change in the presentationof the video. In one example, this involves detecting a second change inthe viewing direction of the eye, determining that the person hasresumed focusing on the video, and based on determining the person hasresumed focusing on the video, changing the presentation of the videoback to its prior state.

The monitoring of the eye can further involve tracking pupil dilationwhile the person is focused on the video, determining a level ofinterest based on pupil dilation, associating the level of interest withcontent displayed in video, and presenting an advertisement selectedbased on the level of interest and content displayed in the video, orupdating a profile of the person based on the level of interest and thecontent displayed in the video.

The monitoring of the eye can also facilitate replaying of content thatthe person may have missed while looking away from the video. In oneexample, a user plays a video on a wearable electronic device withoutfocusing on the video, i.e., the video is played in the background. Ifsomething catches the person's attention such that the person focuses onthe video, the video may automatically backup to allow the person toobserve the eye-catching content. This process can involve determiningthat the person has focused on the video, identifying that the personwas interested in the content just presented in the video based ondetermining that the person focused on the video, and replaying thecontent that was just presented in the video.

The monitoring of the eye can also involve determining comfort of theeye, detecting ambient light, and adjusting the brightness of thepresentation of the video based on the determined comfort of the eye anddetected ambient light. For example, if the person is squinting, thebrightness of the display may be reduced.

In addition to monitoring the eye, the tracking device may monitorexternal conditions. In one example, the device monitors the person'ssurroundings. A sensor detecting objects near the person may determinethat a collision has occurred or is about to occur and the videopresentation may be changed in response. In one example, this prevents aperson from walking into a detected pole by stopping display of thevideo prior to the person colliding with the pole.

FIG. 8 is a flow chart of an exemplary method for identifying a person'sinterest based on changes in eye conditions during presentation of videoon electronic devices. Method 800 can be performed by one or more of thedevices of FIG. 1 or any other suitable devices.

Method 800 involves monitoring, via an electronic tracking device, aneye of a person watching a video on a wearable electronic device tomonitor dilation of a pupil of the eye, as shown in block 802.

Method 800 further involves determining a level of interest based on achange in the dilation of the pupil of the eye, as shown in block 804.For example, an increase in the size of the pupil may be identified asan indication of a high level of interest in a product or servicedisplayed in the video. A decrease in a size of the pupil may converselyindicate a disinterest or dislike in a product or service displayed inthe video. Additional eye condition information, e.g., eye opening moreor less, squinting, etc., may additionally or alternatively be used asan indicator of interest or disinterest in the content being displayed.

Method 800 further involves associating the level of interest withcontent displayed in the video when the change occurred, as shown inblock 806. The relative interest of the person in different attributesof a product, a service, or a performance presented in the video isdetermined in one embodiment based on changes in the dilation of thepupil of the eye during presentation of the video.

Method 800 further involves customizing presentation of content on thewearable electronic device based on the level of interest, as shown inblock 808. For example, this can involve providing advertising contentto the person based on an identified high level of interest in aparticular product, person, or topic.

Method 800 may further involve updating a profile of the person based onassociating the level of interest in content displayed in the video whenthe change occurred. Over time a consumer profile of the individual maybe developed to facilitate targeted advertising. Such data collectionand advertising, in one embodiment, keeps the identity of the personanonymous.

Exemplary Computing Environment

Any suitable computing system or group of computing systems can be usedto implement the computer devices 102, 104, 110 a-c of FIG. 1 orotherwise used to implement the techniques and methods disclosed herein.For example, FIG. 9 is a block diagram depicting examples ofimplementations of such components. The computing device 900 can includea processor 902 that is communicatively coupled to a memory 904 and thatexecutes computer-executable program code and/or accesses informationstored in the memory 904 or storage 906. The processor 902 may comprisea microprocessor, an application-specific integrated circuit (“ASIC”), astate machine, or other processing device. The processor 902 can includeone processing device or more than one processing device. Such aprocessor can include or may be in communication with acomputer-readable medium storing instructions that, when executed by theprocessor 902, cause the processor to perform the operations describedherein.

The memory 904 and storage 906 can include any suitable non-transitorycomputer-readable medium. The computer-readable medium can include anyelectronic, optical, magnetic, or other storage device capable ofproviding a processor with computer-readable instructions or otherprogram code. Non-limiting examples of a computer-readable mediuminclude a magnetic disk, memory chip, ROM, RAM, an ASIC, a configuredprocessor, optical storage, magnetic tape or other magnetic storage, orany other medium from which a computer processor can read instructions.The instructions may include processor-specific instructions generatedby a compiler and/or an interpreter from code written in any suitablecomputer-programming language, including, for example, C, C++, C#,Visual Basic, Java, Python, Perl, JavaScript, and ActionScript.

The computing device 800 may also comprise a number of external orinternal devices such as input or output devices. For example, thecomputing device is shown with an input/output (“I/O”) interface 808that can receive input from input devices or provide output to outputdevices. A communication interface 910 may also be included in thecomputing device 900 and can include any device or group of devicessuitable for establishing a wired or wireless data connection to one ormore data networks. Non-limiting examples of the communication interface910 include an Ethernet network adapter, a modem, and/or the like. Thecomputing device 900 can transmit messages as electronic or opticalsignals via the communication interface 910. A bus 912 can also beincluded to communicatively couple one or more components of thecomputing device 900.

The computing device 900 can execute program code that configures theprocessor 902 to perform one or more of the operations described above.The program code can include one or more of the modules of FIG. 2. Theprogram code may be resident in the memory 804, storage 806, or anysuitable computer-readable medium and may be executed by the processor902 or any other suitable processor. In some embodiments, modules can beresident in the memory 904. In additional or alternative embodiments,one or more modules can be resident in a memory that is accessible via adata network, such as a memory accessible to a cloud service.

Numerous specific details are set forth herein to provide a thoroughunderstanding of the claimed subject matter. However, those skilled inthe art will understand that the claimed subject matter may be practicedwithout these specific details. In other instances, methods,apparatuses, or systems that would be known by one of ordinary skillhave not been described in detail so as not to obscure the claimedsubject matter.

Unless specifically stated otherwise, it is appreciated that throughoutthis specification discussions utilizing terms such as “processing,”“computing,” “calculating,” “determining,” and “identifying” or the likerefer to actions or processes of a computing device, such as one or morecomputers or a similar electronic computing device or devices, thatmanipulate or transform data represented as physical electronic ormagnetic quantities within memories, registers, or other informationstorage devices, transmission devices, or display devices of thecomputing platform.

The system or systems discussed herein are not limited to any particularhardware architecture or configuration. A computing device can includeany suitable arrangement of components that provides a resultconditioned on one or more inputs. Suitable computing devices includemultipurpose microprocessor-based computer systems accessing storedsoftware that programs or configures the computing system from a generalpurpose computing apparatus to a specialized computing apparatusimplementing one or more embodiments of the present subject matter. Anysuitable programming, scripting, or other type of language orcombinations of languages may be used to implement the teachingscontained herein in software to be used in programming or configuring acomputing device.

Embodiments of the methods disclosed herein may be performed in theoperation of such computing devices. The order of the blocks presentedin the examples above can be varied—for example, blocks can bere-ordered, combined, and/or broken into sub-blocks. Certain blocks orprocesses can be performed in parallel.

The use of “adapted to” or “configured to” herein is meant as open andinclusive language that does not foreclose devices adapted to orconfigured to perform additional tasks or steps. Additionally, the useof “based on” is meant to be open and inclusive, in that a process,step, calculation, or other action “based on” one or more recitedconditions or values may, in practice, be based on additional conditionsor values beyond those recited. Headings, lists, and numbering includedherein are for ease of explanation only and are not meant to belimiting.

While the present subject matter has been described in detail withrespect to specific embodiments thereof, it will be appreciated thatthose skilled in the art, upon attaining an understanding of theforegoing, may readily produce alterations to, variations of, andequivalents to such embodiments. Accordingly, it should be understoodthat the present disclosure has been presented for purposes of examplerather than limitation, and does not preclude inclusion of suchmodifications, variations, and/or additions to the present subjectmatter as would be readily apparent to one of ordinary skill in the art.

What is claimed is:
 1. A method comprising: monitoring, via anelectronic tracking device of a wearable electronic device, an eye of aperson watching a video presented on a display component of the wearableelectronic device to monitor a viewing direction of the eye;determining, by an analysis engine configured to analyze informationabout a trigger condition of the eye of the person and to determine anappropriate response, the analysis engine including a device orcomponent communicatively coupled to the electronic tracking device,that the person is watching the video based on the viewing direction ofthe eye; detecting, by the electronic tracking device, an eye movementindicating a change in the viewing direction of the eye; determining, bythe analysis engine and responsive to detecting the eye movement, thatthe person is focused on something other than the video based ondetermining a change in a focal plane of the eye; monitoring, by theanalysis engine, the eye movement of the eye subsequent to determiningthat the person is focused on something other than the video;determining, by the analysis engine: that the eye movement is one ofmultiple learned trigger conditions, and a learned response associatedwith the learned trigger condition, wherein the multiple learned triggerconditions and the learned response are based on observations of: (i) aprior eye movement of the person, and (ii) a prior intentional actionother than the prior eye movement and performed by the person to modifypresentation of the video; and performing the learned response to modifypresentation of the video or audio associated with the video on thewearable electronic device based on the learned trigger condition havingbeen performed.
 2. The method of claim 1, wherein determining the changein the focal plane of the eye comprises detecting a change in a size andshape of a lens in the eye.
 3. The method of claim 1, wherein themonitoring of the eye comprises detecting that the viewing direction isconstant in a direction away from the video for at least a thresholdamount of time.
 4. The method of claim 1, further comprising: detecting,by the electronic tracking device, a second eye movement indicating asecond change in the viewing direction of the eye; determining, by theanalysis engine and responsive to detecting the second eye movement,that the person has resumed focusing on the video based on determining asecond change in the focal plane of the eye; based on determining theperson has resumed focusing on the video, resuming, by the analysisengine, the presentation of the video back to content presented prior tothe eye movement.
 5. The method of claim 1, wherein modifying thepresentation of the video or audio associated with the video furthercomprises one or more of: displaying the video in a smaller size displayarea, pausing the video, removing the video from being displayed, orreducing volume of the audio associated with the video.
 6. The method ofclaim 1 further comprising: tracking, via the electronic trackingdevice, pupil dilation while the person is focused on the video;determining, by the analysis engine, a level of interest based on pupildilation; associating, by the analysis engine, the level of interestwith content displayed in video; presenting, by the analysis engine, anadvertisement selected based on the level of interest and contentdisplayed in the video, or updating a profile of the person based on thelevel of interest and the content displayed in the video; and whereinmodifying the presentation of the video on the electronic deviceincludes stopping presentation of the advertisement.
 7. The method ofclaim 1 wherein the wearable electronic device is eyeglasses, whereinthe electronic tracking device is part of or secured to the eyeglasses.8. The method of claim 1, wherein determining that the person is focusedon something other than the video is further based on a detection of: asound of a voice of a particular person detected by the electronictracking device; and ambient noise detected by the electronic trackingdevice.
 9. The method of claim 8, wherein determining that the person isfocused on something other than the video is further based on adetection of: a change of movement of a head of the person detected bythe electronic tracking device; and the eye closing for a length of timelonger than a blink threshold, as detected by the electronic trackingdevice.
 10. The method of claim 1 further comprising: determining, bythe analysis engine, comfort of the eye; detecting, by the electronictracking device, ambient light; and adjusting, by the analysis engine,brightness of presentation of the video based on the determined comfortof the eye and detected ambient light.
 11. The method of claim 1,further comprising: while the presented video is played without theperson focusing on the video, determining, by the electronic trackingdevice, that the person has focused on the video; identifying, by theanalysis engine, that the person was interested in played content justpresented in the video based on the determination that the person hasfocused on the video; and replaying the content that was presented inthe video when the person has focused on the video.
 12. The method ofclaim 1, further comprising: the monitoring further comprisingmonitoring, via the electronic tracking device, a tear layer of the eyeof the person watching the video, the tear layer of the eyecorresponding to a moisture content level proximate to the eye; thedetermining further comprising determining, by the analysis engine, alevel of interest based on a change in the tear layer of the eye asdetected by the electronic tracking device; associating, by the analysisengine, the level of interest with content displayed in the video whenthe change occurred; and customizing, by the analysis engine, apresentation of further content on the wearable electronic device basedon the level of interest.
 13. The method of claim 12, furthercomprising: monitoring, by the electronic tracking device, a change indilation of a pupil of the eye; identifying, by the analysis engine,that an increase in a size of the pupil indicates a high level ofinterest in a product or service displayed in the video; and providingadvertising content to the person based on the identified high level ofinterest, the advertising content relating to the product or service.14. The method of claim 12, further comprising: monitoring, by theelectronic tracking device, a change in dilation of a pupil of the eye;and identifying, by the analysis engine, that a decrease in a size ofthe pupil indicates a disinterest or dislike in a product or servicedisplayed in the video.
 15. The method of claim 14 further comprisingidentifying, by the analysis engine, squinting of the eye as anadditional indicator of disinterest or dislike.
 16. The method of claim12 further comprising updating, by the analysis engine, a profile of theperson based on the level of interest in content displayed in the videowhen the change occurred.
 17. The method of claim 12 further comprisingdetermining, by the analysis engine, relative interest of the person indifferent attributes of a product, a service, or a performance presentedin the video based on changes in the tear layer or changes in dilationof a pupil of the eye during presentation of the video.
 18. A wearableelectronic device comprising: a processor; a non-transitory computerreadable medium that, when executed by the processor, performsoperations comprising: presenting video on a display component of awearable electronic device; monitoring a viewing direction of an eye ofa person watching the video on the display component of the wearableelectronic device, wherein the monitoring uses information from a cameraor sensor that moves with a head of the person such that the camera orsensor remains in a fixed position relative to the eye as the headmoves; determining that the person is watching the video based on theviewing direction of the eye; detecting, based on the information fromthe camera or sensor, an eye movement indicating a change in the viewingdirection of the eye; determining, responsive to detecting the eyemovement, that the person is focused on something other than the videobased on determining a change in a focal plane of the eye; monitoringthe eye movement of the eye subsequent to determining that the person isfocused on something other than the video; determining: that the eyemovement is one of multiple learned trigger conditions, and a learnedresponse associated with the learned trigger condition, wherein themultiple learned trigger conditions and the learned response are basedon observations of: (i) a prior eye movement of the person, and (ii) aprior intentional action other than the prior eye movement and performedby the person to modify presentation of the video; and performing thelearned response to modify presentation of the video on the displaycomponent or audio associated with the video on the wearable electronicdevice based on the learned trigger condition having been performed. 19.The wearable electronic device of claim 18, wherein determining that theperson is focused on something other than the video is further based ona detection of: a change of movement of a head of the person detected bythe electronic tracking device; a sound of a voice of a particularperson detected by the electronic tracking device; ambient noisedetected by the electronic tracking device; and the eye closing for alength of time longer than a blink threshold, as detected by theelectronic tracking device.
 20. A method comprising: monitoring, via anelectronic tracking device of a wearable electronic device, an eye of aperson watching a video presented on a display component of the wearableelectronic device to monitor a viewing direction of the eye;determining, by an analysis engine configured to analyze informationabout a trigger condition of the eye of the person and to determine anappropriate response, the analysis engine including a device orcomponent communicatively coupled to the electronic tracking device,that the person is watching the video based on the viewing direction ofthe eye; detecting, by the electronic tracking device, an eye movementindicating a change in viewing direction of the eye; determining, by theanalysis engine and responsive to detecting the eye movement, that theperson is focused on something other than the video based on determininga change in a focal plane of the eye; determining, by the analysisengine, that the person has intentionally performed an action other thanthe eye movement, the action determined, based on prior observations, tobe associated with the change in focal plane, wherein the action isperformed by the person to modify presentation of the video;determining, by the analysis engine, that the eye movement is a learnedtrigger condition and that the action is a learned response associatedwith the learned trigger condition; and determining the learned triggercondition and the learned response based on (i) the change in focalplane, and (ii) the intentional action.